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Abstract 

In this paper we give a definition for quantum Kolmogorov complexity. In the classical 
setting, the Kolmogorov complexity of a string is the length of the shortest program that can 
produce this string as its output. It is a measure of the amount of innate randomness (or 
information) contained in the string. 

We define the quantum Kolmogorov complexity of a qubit string as the length of the 
shortest quantum input to a universal quantum Turing machine that produces the initial 
qubit string with high fidelity. The definition of Vitanyi |2fl] measures the amount of classical 
information, whereas we consider the amount of quantum information in a qubit string. We 
argue that our definition is natural and is an accurate representation of the amount of quantum 
information contained in a quantum state. 

1 Introduction 

In classical computations, the Kolmogorov-SolomonofF-Chaitin (Kolmogorov, for short) complexity 
of a finite string is a measure of its randomness. || [lj| The Kolmogorov complexity of x is the 
length of the shortest program which produces x as its output. It can be seen as a lower bound 
on the optimal compression that x can undergo, and it is closely related to Shannon information 
theory.|, 

Kolmogorov complexity has been shown to have a windfall of applications in fields as diverse 
as learning theory, complexity theory, combinatorics and graph theory, analysis of algorithms, to 
name just a few. 

With the advent of quantum computation, it is natural to ask what is a good definition for the 
Kolmogorov complexity of quantum strings. Our goal in this paper is to argue that our definition 
is a natural and robust measure the amount of quantum information contained in a quantum 
string, which has several appealing properties. 

Recently, Paul Vitanyi p0| has also proposed a definition for quantum algorithmic complexity. 
Our definition differs significantly from Vitanyi's: the definition he proposes is a measure of the 
amount of classical information necessary to approximate the quantum state. 

The paper will be organized as follows: In Section ^, we give basic notation, definitions, prior 
work and some theorems that will be used in proofs in the paper. In Section ^ we give our 
definition of quantum Kolmogorov complexity. In Section |5| we prove the invariance theorem. 
Section ^ compares the properties of quantum and classical Kolmogorov complexity, including 
incompressibility, subadditivity, and the complexity of copies. Section ^| discusses the relationship 
with quantum information theory. We conclude with a discussion of possible extensions and future 
work. 
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2 What is a Good Definition? 



A good definition of quantum Kolmogorov complexity should meet the following fundamental 
criteria. These are intended to insure that it gives an accurate representation of the information 
content of a quantum string. 

• It should be robust, that is, invariant under the choice of the underlying quantum Turing 
machine. 

• It should bear a strong relationship with quantum information theory. 

• It should be closely related to classical complexity on classical strings. 

However, quantum Kolmogorov complexity should not be expected to always behave the way 
classical Kolmogorov complexity does. The reader may want to bear in mind quantum phenomena 
such as the no-cloning theorem, whose consequences we will discuss later in the paper. Q 

2.1 Critical issues 

A first attempt at defining quantum Kolmogorov complexity of a qubit string X is to consider the 
length of the shortest quantum program that produces X as its output. There are many questions 
that arise from this 'definition'. 

Bits or qubits? The first question to consider is whether we want to measure the amount of 
algorithmic information of a string in bits, or in qubits. Note that bit strings (programs) are 
countable, whereas qubit strings are uncountable, so any definition that measures in bits would 
have to overcome this apparent contradiction. Paul Vitanyi |2(| considers classical descriptions of 
qubit strings, whereas we consider qubit descriptions. 

Exact or inexact? What does 'produce' mean? Is a minimal program required to produce 
the string X exactly, or only up to some fidelity? In the latter case, is the fidelity a constant? 
Otherwise, how is it parameterized? (For exact simulation, we can only hope to simulate a 
subclass of the Turing machines, say by restricting the set of possible amplitudes. What would be 
a reasonable choice?) We will use an approximation scheme. 

What model of computation? Size of quantum circuits is not an appropriate measure since 
large circuits may be very simple to describe. The Turing machine model is the appropriate one 
to consider. 

What is meant by 'quantum program?' A program for a quantum Turing machine is its 
input, and if we want to count program length in qubits, we must allow for 'programs' to be 
arbitrary qubit strings. (These can be viewed as programs whose code may include some auxiliary 
'hard-coded' qubit strings.) 

One-time description or multiple generation? In the classical setting, the program that 
prints the string x can be run as many times as desired. Because of the no-cloning theorem of 
quantum physics however, we cannot assume that the shortest program can be run several times 
to produce several copies of the same string. This may be due to the fact that it is not possible 
to recover the program without losing its output. There is also a second reason not to choose the 
multiple generation option. The complex-valued parameters a and f3 of a qubit \q) — a\0) + (3\1) 
can contain an unbounded amount of information. If we would be able to reproduce q over and 
over again, then we would have to conclude that the single qubit q contains an unlimited amount of 
information. This contradicts the fact that the quantum mechanical system of q can only contain 
one bit of information.]^] For the above two reason, we will not require a 'reusability' condition. 

3 Preliminaries 

We start with some notation, definitions, and results that will be used to prove the results in this 
paper. 



3.1 Notation 



We use X,y,. . . to denote finite, classical Boolean strings. When we write we mean the quantum 
state vector in the standard basis that corresponds to the classical string x. In general we use 
<j), ip, . . . to denote quantum pure states. Mixed states are represented by the letters p, a etc. We 
also use uppercase letters X, Y, ... for (mixed) quantum states that are strings of qubits. The 
terms quantum state, qubit string, and quantum register are used interchangeably (sometimes 
to emphasize the purpose of the quantum state at hand.) Lower-case letters i,j,k,l,m,n denote 
integer indices or string lengths. 

For classical strings over the alphabet £ = {0, 1}, £(x) denotes the length of the string. For 
finite sets A, \ A\ denotes the cardinality of the set. Concatenation of x, y is written as the juxta- 
position xy, and the n-fold concatenation of x is written x n . 

For Hilbert spaces, we write Hd for the d-dimensional Hilbert space and Ti. m for the m-fold 
tensor product space H®- ■ -®H. A pure quantum state 4> represented as a vector in such a Hilbert 
space is denoted by the ket \<p). The fidelity between two pure states <f> and ip is the absolute value 
of the inner product of the two vectors: |(<^|^)| (although some authors use the square of this 
value). 

We slightly abuse notation by sometimes letting the state symbols cf>, p, . . . also stand for the 
corresponding density matrices. Hence, a pure state <fi as a Hilbert space vector is denoted by \<j)), 
whereas its density matrix |</>)(</>| can also be denoted by <f>. 

A density matrix can always be decomposed as a mixture of pure, orthogonal states: p = 
Si Pi 1 0») w hhpi,p2, •■■ a probability distribution over the mutually orthogonal states </>i, </>2> ■ ■ 
The matrix p represents a pure state if and only if p 2 = p, in which case we can also say yfp = p. 
The square root of a general mixed state is described by 



We use the above rule for the generalization of the fidelity to mixed states. The fidelity between 
two density matrices p and a is defined by 



For pure states <f> and ip, the above definition coincides again with the familiar K^Ii/j)!. If 
Fidelity(p, a) = 1, then p = a, and vice versa. 

An ensemble £ is specific distribution pi, p2, ■ . ■ over a set of (mixed) states pi, p2, We 

denote this by £ — {(pi,Pi)}. The average state of such an ensemble £ is p = J2iPiPi- ^ n average 
state corresponds to several different ensembles. When an ensemble is used to produce a sequence 
of states pi according to the probabilities pi, we speak of a source £. 

The length of a quantum state is denoted by £(X), by which we mean the smallest / for which 
X sits in the 2 z -dimensional Hilbert space (in the standard basis). 

A transformation $ on the space of density matrices is allowed by the laws of quantum me- 
chanics if and if only it is a completely positive, trace preserving mapping. 

3.2 Classical Kolmogorov complexity 

The Kolmogorov complexity of a string, in the classical setting, is the length of the shortest 
program which prints this string on an empty input. |l2| 

Formally, this is stated first relative to a partial computable function, which as we know can 
be computed by a Turing machine. 

Definition 1 Fix a Turing machine T that computes the partial computable function $. For any 
pair of strings i,j/£ {0, 1}*, the Kolmogorov complexity of x relative to y (with respect to <&) is 
defined as 





Fidelity (p, a) 




(1) 



C*(x\y) = Mm{£(p) : <P{p,y) = x}. 



When y is the empty string, we simply write C$ (x) . Also the notation Ct (x \ y) is used. 

The key theorem on which rests the robustness of Kolmogorov complexity is the invariance 
theorem. This theorem states that the length of shortest programs does not depend by more than 
an additive constant on the underlying Turing machine. In the classical case, this theorem is 
proven with the existence of a universal Turing machine. This machine has two inputs: a finite 
description of the original Turing machine, and the program that this Turing machine executes to 
output the string. 

More formally, the invariance theorem in the classical case can be stated as follows. 

Theorem 1 There is a universal partial computable function <E>o such that for any partial com- 
putable $ and pair of strings x, y, 

C<i. (x\y) < C$(x\y)+c, 

where c is a constant depending only on <&. 

Giving an invariance theorem will be key to showing that quantum Kolmogorov complexity is 
robust. 

Since for any string x of length n, C(x) < n + 0(1), a string which has complexity at least n 
is called incompressible. The existence of incompressible strings is a crucial fact of Kolmogorov 
complexity. 

Proposition 1 For every string length n, there is a string x of length n such that C[x) > n. 

The proof that there exists incompressible strings is a simple application of the pigeonhole 
principle. By comparing the number of strings of length n (2™) and the number of programs of 
length smaller than n (2™ — 1 in total), one must conclude that there is at least one string of length 
n which is not the output of any of the program of length < n. 



3.3 Entropy of classical sources 

The Shannon entropy of a random source that emits symbols from an alphabet is a measure of 
the amount of randomness in the source. [Q, [T^] 

Definition 2 Let A be a random source that emits letter Xi (independently) with probability pi. 
The Shannon entropy H of A is H(A) — — 'Y^ i Pi^o i gpi. 

In the classical setting, Kolmogorov complexity and Shannon entropy are closely related, as 
we describe now. This is an important property of Kolmogorov complexity, and one would expect 
a similarly strong relationship to hold between quantum Kolmogorov complexity and quantum 
entropy. 

Shannon's noiseless coding theorem states that the entropy corresponds to the average number 
of bits required to encode sequences of character emitted by a random source. 

Proposition 2 Shannon's noiseless coding Consider a classical channel A that is used 

to transmit letters taken from an ensemble {(xi,pi)}, where the Xi are the letters and pi their 
corresponding probabilities. Then 

1. for any e, 5, there is an n such that there is an encoding that on n letters encodes on average 
the letters with H(A) + S bits for which the probability of successfully decoding Psucccss > 1 — e; 

2. for any e, 5, there is an n such that for any 5' , there is an e' such that if the channel encodes 
n letters, each letter with less than H(A) — 8' bits per letter, then the probability of success 

P < 0- n i s '- s ) J- F i 

1 success _ ^ T c ■ 



In the classical case, the Kolmogorov complexity of a string is bounded by the entropy of a 
source 'likely to have emitted this string'. A brief summary of the argument is included here. 
(Details can be found in [jl2], page 180].) 

Let a; be a (long) binary string. It can be broken down into m blocks of length k, where each 
block is thought of as a character in an alphabet of size 2 fe . Define the frequency /, of a character 
Ci to be the number of times it appears as a block in x, and let A represent the source {ci, fi/m}. 
To reconstruct x, it suffices to provide the frequency of each character (5Zjlog/j bits) and then 
specify x among the strings that share this frequency pattern. With some manipulations, it can 
be shown that 

Proposition 3 

C(x) < m(H(A)+j), 
where A is the source defined in the discussion above, and 7 vanishes as m goes to infinity. 

3.4 Quantum information theory 

We have seen that in the classical setting, Kolmogorov complexity is very closely related to Shannon 
entropy. In this section we describe the quantum, or Von Neumann, entropy, related measures, 
and important properties which will be used in the proofs of our results. 

Definition 3 Von Neumann entropy: The Von Neumann entropy of a mixed state p is defined 
as S(p) = tr(— plogp). If we decompose p into its mutually orthogonal eigenstates fa, we see that 

S(p) = S (^2 Pi \fa)(fa\j = H{p), 

where Hip) is the Shannon entropy of the probability distribution p\,pi, ■ ■ ■ 

A source £ = {ipi,Pi)} has an associated Von Neumann entropy S(p) of the average state 
p = 'Y^iViPi- Schumacher's noiseless coding theorem |jl6f shows how to obtain an encoding with 
average letter-length S(p) for a source of pure states, where the fidelity of the encoding goes to 1 
as the number of letters emitted by the source goes to infinity. (A survey can be found in Preskill's 
lecture notes jl5| page 190] or in Nielsen's thesis jl4| Chapter 7].) 

We will use a slightly stronger result, which gives a universal compression scheme. That is, 
one that does not depend on the source itself, but only on its entropy. This result is due to Jozsa 
et al. ||, building upon the work of Jozsa and Schumacher JT~0| ] . 

Theorem 2 Universal quantum compression (see ^7^ , Consider pure state sources 

£ = {{4>i,Pi)}- For any e,S, there is an n = n(e, S) such that for any entropy bound S, there is 
an encoding scheme that works for any source of Von Neumann entropy at most S that has the 
following properties. Let p = ~YlnPi\fa){fa\ be the average state, with all \fa) G Hd, and p has 
entropy Sip) < S, then 

1. Each \4>i) can be encoded by a code word a, which has length < S + S + ^(d 2 log(n + 1)). 

2. For each i, Fidelity (^, oA > 1 — e. 

We continue the section by defining the 'x quantity' for ensembles. 

Definition 4 Holevo's chi quantity jfy: For an ensemble £ — {{pi, pi)}, with p — YliPiPi' 
Holevo's chi quantity equals 



xi£) - S(p)-Y^PiSiPi). 

i 



Note that the x quantity depends not only on p, but also on the specific pairs pi). 

The following monotonicity property of Lindblad and Uhlmann will be very useful later in the 
paper. 



Theorem 3 Lindblad- Uhlmann monotonicity l lo, 19 j: Let £ = {(pi,Pi)} be an ensemble, 
and $ a completely positive, trace preserving mapping. For every such £ and %, it holds that: 
%($(£)) < where %{£) is the transformed ensemble {($(Pi)>Pi)} ■ 

The entropy of finite systems is robust against small changes. This continuity of S over the 
space of finite dimensional density matrices p is also called insensitivity, and is expressed by the 
following lemma. 



Lemma 1 Insensitivity of Von Neumann entropy (see Section LI. A in [21]): If a se- 
quence pi,P2, ■ ■ ■, has limfe^oo p k = p, then also lim^oo S(p k ) = S(p). 

Proof: The convergence of p\ , p%, . . . to p is understood to use some kind of norm for the density 
matrices that is continuous in the matrix entries (i|p|j)- (The operator norm \p\ = tr(pp*), for 
example.) The entropy S(p) is a continuous function of the finite set of eigenvalues of p. These 
eigenvalues are also continuous in the entries of p. □ 
Further background on these measures of quantum information and their properties can be 
found in jlR Chapter 5]. Another good source is Nielsen's thesis ifTif. 



3.5 Symmetric spaces 

We use the symmetric subspace of the Hilbert space to show some of our results on copies of quan- 
tum states. Let be a Hilbert space of dimension D with the basis states labeled |1), . . . , \D). 
The symmetric subspace Sym(7i^) of the m-fold tensor product space Tip is a subspace spanned 
by as many basis vectors as there are multisets of size m of {1, . . . , D}. Let A = {i\, . . . , i m } 
be such a multiset of {1, . . . , D}. Then, \sa) is the normalized superposition of all the different 
permutations of i\, . . . ,i m - The set of the different vectors \sa) (ranging over the multisets A) is 
an orthogonal basis of the symmetric subspace Sym(7i^, 1 ). Hence the dimension of the symmet- 
ric subspace is ("J^ 1 ). (Th is is because choosing a multiset is the same thing as splitting m 
consecutive elements into D (possibly empty) intervals, where the size of ith interval represents 
the number of times the ith clement appears in the multiset. The number of ways of splitting an 
interval of size m into D intervals is ("J^i" 1 )-) 

An equivalent definition of the symmetric subspace is that it is the smallest subspace that 
contains all the states of the form \<j)) m , for all \<p) S TLd- (For more on the symmetric subspace 
and its properties, see the paper by Barenco et al. Q.) 



3.6 Accumulation of errors 

The following lemma is used to bound the error introduced when composing two inexact quantum 
procedures. 

Lemma 2 Fidelity of composition: If Fidelity(p, p') > 1 — <5i and Fidelity (p', p") > 1 — 62, 
then Fidelity(p,p") > 1 - 25 x - 25 2 - 

Proof: This follows from the fact that the fidelity between two mixed states p and a equals the 
maximum 'pure state fidelity' where (j) an d ip are 'purifications' of p and a. (See |6) for 

more details on this.) □ 
In order to give bounds on the complexity of several copies of a state, as we do in Section |6.3| , 
we need the following bound on the total error in the n-fold tensor product of the approximation 
of a given state. 

Lemma 3 Let p n and a n be the n-fold copies of the mixed states p and a, then Fidelity(p™, a 11 ) = 
(Fidelity (p, a))". 



Proof: This follows directly from the definition Fidelity(p, a) = tr ' ^fp ■ a ■ y/p)- 



a 



4 Quantum Kolmogorov Complexity 



We define the quantum Kolmogorov complexity QC of a string of qubits, relative to a quantum 
Turing machine M, as the length of the shortest qubit string which when given as input to M, 
produces on its output register the qubit string. (Note that we only allow M that have computable 
transition amplitudes. See the articles [5|, and particularly Definition 3.2.2 in Q], for a further 
description of this computational model.) 

4.1 Input/Output Conventions 

We give some precisions about what is meant by 'input' and 'output'. 

We consider quantum Turing machines with two heads on two one-way infinite tapes. We allow 
the input tape to be changed. This is required: for example, the contents of the input may have 
to be moved to the output tape. 

For a QTM M with a single input, when we say M starts with input Y, we mean that M 
starts with the quantum state |F$00 • • •) on its input tape, and |00 • • •) on the output tape. The 
$ symbol is a special endmarker (or blank) symbol. 

Note that testing for the end of the input can be done without disturbing the input, since we 
assume that the '$' state is orthogonal to the '0' and '1' states. (This is analogous to the classical 
case, where where Turing machine inputs are encoded in a three-letter alphabet; nevertheless we 
consider the actual input to be encoded only over the characters and 1.) 

A string is a proper input if the endmarker symbol appears only once and is not in superposition 
with any other position of the tape. We dismiss any non-proper inputs. 

For a QTM with multiple inputs, we also assume that there is a convention for encoding the 
multiple inputs so that they can be individually recovered. For example, when we write M{P, Y), 
we may assume that the input tape is initialized to |l £ ( p ) py $00 • • •). We only count the length of X 
and Y for the length of the input. Likewise, for multiple outputs, if we write M(P, Y) = (X\ , X2), 
we mean that X\ and X2 must be encoded according to a prearranged convention so that X\ and 
Xi can be recovered individually from the output tape. 

(Note that we do not define prefix-free complexity in this paper. The programs themselves 
need not be prefix-free.) 

We let M T (X) denote the contents of the output tape after T steps of computation. We 
consider only QTMs which do not modify their output tape after they have halted. (Because of 
reversibility, they may modify the input tape after reaching the halting state.) The output M{X) 
is the content of the output tape at any time after M has stopped changing its output tape. 

4.2 Definitions 

For some fidelity function / : N — > [0, 1] we will now define the corresponding quantum Kolmogorov 
complexity. 

Definition 5 Quantum Kolmogorov complexity with fidelity f: For any quantum Turing 
machine M and qubit string X , the f -approximation quantum Kolmogorov complexity, denoted 
QCj^(X), is the length of the smallest qubit string P such that for any fidelity parameter k we 
have Fidelity(X,Af(P,l fe )) > f(k). 

Note that we require that the same string P be used for all approximation parameters k. 
We will say that program P M-computes X with fidelity f(k) if Vfc, Fidelity (M(P, l fe ), X) > 

/(*)■ 

If / is the constant function 1, we have the following definition. 

Definition 6 Quantum Kolmogorov complexity with perfect fidelity: The perfect fidelity 
quantum Kolmogorov complexity is QC 1 M {X). 



The problem with this definition is that it is not known whether an invariance theorem can be 
given for the ideal Kolmogorov complexity. This is because the invariance theorems that are known 
for quantum computers deal with approximating procedures. We therefore prove an invariance 
theorem for a weaker, limiting version, where the output of M must have high fidelity with respect 
to the target string X: Fidelity (X, M{P)) w 1. 

Definition 7 Quantum Kolmogorov complexity with bounded fidelity: For any constant 
e < 1, QC e M (X) is the constant-fidelity quantum Kolmogorov complexity. 

There are two problems with this definition. First, it may be the case that some strings are 
very easy to describe up to a given constant, but inherently very hard to describe for a smaller 
error. Second, it may be the case that some strings are easier to describe up to a given constant on 
one machine, but not on another machine. For these two reasons, this definition does not appear 
to be robust. 

A stronger notion of approximability is the existence of an approximation scheme. (See, for 
example, the book by Garey and Johnson [Q, Chapter 6] for more on approximation algorithms 
and approximation schemes.) 

For constant-approximability, different algorithms (with different sizes) can exist for different 
constants. In an approximation scheme, a single program takes as auxiliary input an approxi- 
mation parameter k, and produces an output that approximates the value we want within the 
approximation parameter. This is the model we wish to adopt for quantum Kolmogorov complex- 
ity. 

Definition 8 Quantum Kolmogorov complexity with fidelity converging to 1 : The com- 
plexity QC M (X) is equal to QC M (X), where f(k) = 1 — 4. 

We choose to encode the fidelity parameter in unary, and the convergence function to be 
f(k) = 1 — 4 so that the model remains robust when polynomial time bounds are added. We 
discuss this further in Section ^|. 

We may also define QC ^ (X\Y), the complexity of producing X when Y is given as an auxiliary 
input, in the usual way. 

5 Invariance 

To show that our definition is robust we must show that the complexity of a qubit string does not 
depend on the underlying quantum Turing machine. 

We use the following result, proved in the paper of Bernstein and Vazirani 0. To be precise, 
we use the notation M to denote the classical description of the quantum Turing machine M. 
(Recall that we only consider quantum Turing machines whose amplitudes can be computed to 
arbitrary precision with a finite classical description.) 

Theorem 4 Universal quantum Turing machine (see There exists a universal quan- 

tum Turing machine U that has a finite classical description such that the following holds. For any 
quantum Turing machine M (which has a finite classical description), for any pure state X , for any 
approximation parameter k, and any number of time steps T , Fidelity(C7 (M , X, l fc , T), M T {X)) > 
1 — A . Recall that M T is the contents of the output tape of M after T time steps. 

Theorem 5 There is a universal quantum Turing machine U such that for any quantum Turing 
machine M and qubit strings X, 

QC${X) < QC^(X)+c M , 



where cm is a constant depending only on M . 



Proof: The proof follows from the existence of a universal quantum Turing machine, as proven 
by Bernstein and Vazirani Q. Let U be this UTM as mentioned above. The constant cm 
represents the size of the finite description that U requires to calculate the transition ampli- 
tudes of the machine M. Let P be the state that witness that QC M (X) = £(P), and hence 
Fidelity(X, M (P, l fc )) > 1 - \ for every k. 

With the description corresponding to cm , U can simulate with arbitrary accuracy the behavior 
of M. Specifically, U can simulate machine M on input (P, l 4k ) with a fidelity of 1— jr. Therefore, 
by Lemma §, Fidelity(X, U(M, P, l ik )) > 1 - ± . " □ 

The same holds true for the conditional complexity, that is, 3UVM, X,Y, QC]j (X\Y) < 
QC m (X\Y)+cm- 

Henceforth, we will fix a universal quantum Turing machine U and simply write QC(X) instead 
of QCy(X). Likewise we write QC(X\Y) instead of QC]){X\Y). We also abuse notation and 
write M instead of M to represent the code of the quantum Turing machine M used as an input 
to the universal Turing machine. 

We may also define time-bounded QC is the usual way, that is, fix T : N — > N a fully-time- 
computable function. Then QC T (X\Y) is the length of the shortest program which on input 
Y, l k , produces X on its output tape after T(£(X) + £(Yj) computation steps. The Bernstein and 
Vazirani simulation entails a polynomial time blowup (polynomial in the length of the input and 
the length of the fidelity parameter encoded in unary), so there is a polynomial time blowup in 
the corresponding invariance theorem. 

The simplest application of the invariance theorem is the following proposition. 

Proposition 4 For any qubit string X , QC{X) < £(X) +c, where c is a constant depending only 
on our choice of the underlying universal Turing machine. 

Proof: Consider the quantum Turing machine M that moves its input to the output tape, yielding 
QC M (X) — £{X). The proposition follows by invariance. □ 



6 Properties of Quantum Kolmogorov Complexity 

In this section we compare classical and quantum Kolmogorov complexity by examining several 
properties of both. We find that many of the properties of the classical complexity, or natural 
analogues thereof, also hold for the quantum complexity. A notable exception is the complexity 
of m-fold copies of arbitrary qubit strings. 

6.1 Correspondence for classical strings 

We would like to show that for classical states, classical and quantum Kolmogorov complexity 
coincide, up to a constant additive term. 

Proposition 5 For any finite, classical string x, QC(x) < C(x) + 0(1). 

(The constant hidden by the big-O notation depends only on the underlying universal Turing 
machine.) 

Proof: This is clear: the universal quantum computer can also simulate any classical Turing 
machine. □ 
We leave as a tantalizing open question whether the converse is also true, that is: 

Open Problem 1 Is there a constant c such that for every finite, classical string x, C(x) < 
QC(x)+c? 



6.2 Quantum incompressibility 



In this section, we show that there exist quantum-incompressible strings. 

Our main theorem is a very general form of the incompressibility theorem. We state some 
useful special cases as corollaries. 

Assume we want to consider the minimal-length programs that describe a set of quantum states. 
In general, these may be pure or mixed states. We will use the following notation throughout the 
proof. The mixed states pi, . . . , pm be are the target strings (those we want to produce as output). 
Their minimal- length programs will be &\ , . . . , o~m , respectively. The central idea is that if the 
states pi are sufficiently different, then the programs Cj must be different as well. We turn this 
into a quantitative statement with the use of the insensitive chi quantity in combination with the 
monotonicity of quantum mechanics. 

Theorem 6 For any set of strings pi, ■ ■ ■ ,pM such that \/i,QC(pi) < I, this I is bounded from 
below by 

i 

where p is the 'average' density matrix p — jj X^P;- 

(Stated slightly differently, this says that there is an i such that QC(pi) > S(p) — i S{pi).) 

Proof: Take p\, . . . , pu and their minimal programs ci, . . . , om (and hence QC(pi) = £(<7i)). Let 
$ k be the completely positive, trace preserving map corresponding to the universal QTM U with 
fidelity parameter k. With this, we define the following three uniform ensembles: 

• the ensemble £ = {(/?», jj} of the original strings, 

• £ a the ensemble of programs {(<t<, jj)}, and 

• the ensemble of the fc-approximations £ k — % k (£ a ) — {(p k , jw)}, with p k — $ k (ai). 

By the monotonicity of Theorem || we know that for every k, x{£ k ) < xi^a)- The chi factor of 
the ensemble £ a is upper bounded by the maximum size of its strings: x(£ CT ) < maxi{£((7i)} < I. 
Thus the only thing that remains to be proven is that x{£ k )i f° r sufficiently big k, is 'close' to 
x(£)- This will be done by using the insensitivity of the Von Neumann entropy. 

By definition, for all i, lim^oo Fidelity(pj, p k ) = 1, and hence lim^oo p k = pi. Because the 
ensembles £ and £ k have only a finite number (M) of states, we can use Lemma [j], to obtain 
limfc^oo x(£ k ) = x{£)- This shows that for any 6 > 0, there exists a k such that — 5 < x(£ k )- 
With the above inequalities we can therefore conclude that x(£) — S < I holds for arbitrary small 
6 > 0, and hence that I > %(£ ). □ 

The following four corollaries are straightforward with the above theorem. 

Corollary 1 For every length n, there is an incompressible classical string of length n. 

Proof: Apply Theorem || to the set of classical strings of n bits: p x = \x){x\ for all x e {0, 1}™. 
All p x are pure states with zero Von Neumann entropy, hence the lower bound on I reads I > S(p). 
The average state p = c 2r n ^Zx ^ s ^ ne total mixture 2~ n I with entropy S(p) = n, hence 

indeed I >n. □ 

Corollary 2 For any set of orthogonal pure states \4>i), ■ • ■ , \4>m), the smallest I such that for all 
i, QC{4>i) < I is at least logM . (Stated differently, there is an i such that QC(4>i) > \ogM.) 

Proof: All the pure states have zero entropy S(<j>i) — 0, hence by Theorem ^: I > S(p). Be- 
cause all (f>iS are mutually orthogonal, this Von Neumann entropy S(p) of the average state 
P = W Si 1 4>i) (<t>i I equals log M. □ 



Corollary 3 For every length n, at least 2 n — 2" c + 1 qubit strings of length n have complexity 
at least n — c. 

Corollary 4 For any set of pure states \<j>i), ■ ■ ■ , \4>m) , the smallest I such that for all i, QC(<f>i) < 
I is at least S(p), where p — -h J2i l&X&l- 

6.3 The complexity of copies 

A case where quantum Kolmogorov complexity behaves differently from classical Kolmogorov 
complexity is that, in general, the relation C(x m ) < C(x) + O(logm) does not hold, as we show 
below. We give an upper and a lower bound for the Kolmogorov complexity of X m . 

Theorem 7 QC(X m ) < log f^^ 1 ) + O(logm) + (9(log QC(X)). 

Proof: First we sketch the proof, omitting the effect of the approximation. Consider any qubit 
string X whose minimal- length program is Px- To produce to copies of X, it suffices to produce 
m copies of Px and make to runs of Px ■ 

Let I be the length of Px', we call TL the 2'-dimensional Hubert space. Consider H m = 
Ti® ■ ■ ■ ®H, the m-fold tensor product of H. The symmetric subspace Sym(H m ) is ci-dimensional, 

where d — ('"^J" 1 )- The state Px sits in this symmetric subspace, and can therefore be encoded 
exactly using logd + O(logm) + O(logZ) qubits, where the O(logm) and O(logZ) terms are used 
to describe the rotation onto Sym(7i m ). Hence, the quantum Kolmogorov complexity of X m is 
bounded from above by logc? + O(logm) + O(logZ) qubits. 

For the full proof, we will need to take into account the effect of the imperfect fidelities of the 
different computations. 

To achieve a fidelity of 1 — \ , we will compute m copies of the minimal program Px to a fidelity 
of 1 — jr— . On each copy, we simulate the program with fidelity of 1 — jr— , and thus obtain the 
strings X; (1 < i < m), each of which has (according to Lemma |^) fidelity 1 — ^ with the target 
string X. By Lemma || we get a total fidelity of at least 1 — ^. 

We now proceed to the details of the proof. First we introduce some notation. 

Assume that for some QTM M, QC M {X) < t{Px) = h where P x M-computes X (with 
fidelity 1 — x for any k.) 

Let R be the rotation that takes qubit strings X rn € Sym(7i m ) to qubit strings of length 
[log(dim(Sym(7i m )))l . More precisely, R is the rotation that takes the ith basis state of Sym(W n ) 
to the «th classical basis state of the Hilbert space of dimension 2r io &( dlm ( s y m (' H '")))l . 

For any fidelity parameter 5, can be computed efficiently and to arbitrary precision. By 
that we mean that for any S, there is a transformation RJ 1 for which the following holds: Let 
Z = R(X m ) for some X e H. If A 7 ™ = R$ l (Z), then for each i, the mixed state X { obtained 
from X by tracing out all components that do not correspond to the ith copy of X, is such that 
Fidelity (A, X,) >1-S. 

We now define the program that witnesses the upper bound on QC(X m ) claimed in the 
theorem. 

Let M' be the quantum Turing machine that does the following on input (Z, I, m, l k ). 

1. Computes Z' = Ry ikm {Z). (When Z is an m-proper input, which we specify below, then 
Z' re Y m for some Y £ H.) 

2. On each 'copy' Y % of Y, runs the QTM M(Y U l 4fcm ). (That is, % is the result of tracing out 
all but the positions of Z' that correspond to the zth block of I qubits.) 

The input Z is an 'm-proper input' if for some Y, Z = R(Y m ). (Note that Z is exactly R(Y m ), 
not an approximation up to some fidelity.) 

If we run the above QTM M' on input (R(P x l ),l,m,l k ) then the output of this M 1 is 
M'(R(P™), I, to, \ k ) — X™ — X\ ■ ■ ■ X m . (Recall that I is the length of P x .) 

It remains to show the following claims. 



Claim 1 Fidelity (X m ,X m ) > 1 - 



Claim 2 T/ie length of the program above for M' is < logd; jm + O(logZ) + O(logm), where 

j _ /m+2'-l\ 
«Z,m — V 2 ! -l / ' 

Claim U follows immediately from the fact that the total length of the inputs R(P x % ),l,m is 
log d + 0(log 1) + 0(log to). 

We prove Claim 0. Since we chose a precision <5 = in step 1, Vi, Fidelity (Px, i^) > 
1 — -rr—- Furthermore, since the computation at step 2 introduces at most an error of -rr—, Vi, 
Fidelity > 1-^ (by Lemma f|) Therefore by Lemma |, Fidelity (X™, X m ) > (l-^)" 1 > 

1 — r • This completes the proof of Claim [l| 

Claim [l] and Claim ^ together give us that QCM'(X rn ) < logdi im + O(logZ) + O(logm) < 
log d ntm + 0(log n) + (9(log to) , where n is the length of X and an upper bound on its complexity. 
By invariance, we can conclude that QC(X m ) < logd njm + O(logn) + O(logTO) + 0(1), which 
proves the theorem. □ 

This upper bound is also very close to being tight for some X, as we show in the next theorem. 

Theorem 8 For every to and n, there is an n-gubit state X such that QC(X m ) > log ( m i 2 _ 1 " 1 ) ■ 

Proof: Fix to and n and let TL be the 2"-dimensional Hilbert space. Consider the (continuous) 
ensemble of all TO-fold tensor product states X m : £ = {(X m ,/x)}, where pT 1 = J XeH dX is the 
appropriate normalization factor. The corresponding average state is calculated by the integral 
p = fi J Xen X m dX . This mixture is the totally mixed state in the symmetric subspace Sym(H m ) 
(see Section 3 in p^|), and hence has entropy S(p) = log ( m ^ 1 2 _^~ 1 ) . Because all X m are pure 

states, we can use Corollary |i| to prove the existence of a X for which QC(X m ) > log ( m ^ 2 _ ] _1 ). 

□ 

6.4 Subadditivity 

Consider the following subadditivity property of classical Kolmogorov complexity. 
Proposition 6 For any x and y, C(x,y) < C(x) + C(y\x) + 0(1). 

In the classical case, we can produce x, and then produce y from x, and print out the combination 
of x and y. In the quantum case, producing Y from X may destroy X. In particular, with X = Y . 
the immediate quantum analogue of Proposition^ would contradict Theorem^ (for to = 2). 
A natural quantum extension of this result is as follows. 

Proposition 7 ForanyX,Y, QC(X,Y) < QC(X,X) + QC(Y\X) + 0(1). 



7 Quantum Information Theory 

In this section we establish a relationship between quantum compression theory and the bounded- 
fidelity version of quantum Kolmogorov complexity. 

One would like to give a direct analogue of Proposition [| However, we believe that such a 
statement does not hold for quantum Kolmogorov complexity. The argument can be summarized 
as follows. In the classical case, given a string x, we can define a source A such that x is in the 
so-called 'typical subspace' of A. This allows us to give a short, exact description of x. 

In the quantum case, we may also define a quantum source likely to have emitted a given qubit 
string X (in an appropriate tensor space). However, we do not get that X is in the typical subspace 
of this source, only that it is close to the typical subspace. How close it can be guaranteed to be 
depends on the length of X. Therefore, for a fixed string length n, we may not be able to get an 
encoding of arbitrary high fidelity. 

We now prove a slightly weaker statement, for bounded- fidelity complexity. 



Theorem 9 Let U be the universal quantum Turing machine from Then {or any e, S there is 
an n such that for any d- dimensional H., and any qubit string X = |0i) ® • • • (8 \4> n ) G 7~l n , 

QC\j{X) < n(S(p)+5+±(d 2 \og(n + l))), 

where p= i J2i I <&) (hi- 
proof: Fix e, 6. Apply Theorem |^ with e' = = S, and let n = n(e',5') be the value from 
the theorem. Let |0i) <8> • ■ ■ <£> \4> n ) G W™ be the string for whose quantum Kolmogorov complexity 
we want to give an upper bound. By Theorem ^, item 1, we get that the length of the encoding 
is what was given in the statement of the theorem. By simulating the decoding algorithm to a 
precision of |, together with Theorem ^, item 2, and Lemma ^, we have that the fidelity of the 
encoding is at least 1 — e. That completes the proof. □ 

8 Extensions and Future Work 

We have argued that the QC of Definition || is a robust notion of Kolmogorov complexity for 
the quantum setting. Nevertheless, it would be interesting to see if an invariance theorem can be 
shown for the ideal quantum Kolmogorov complexity of Definition ^|. 

The number of applications of classical Kolmogorov complexity is countless, and it is our hope 
that this definition will lead to a similar wide variety of applications in quantum complexity theory. 
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